Align Promptfoo assertion grouping vocabulary - #1635

Summary

• Rename the public assertion grouping contract from composite to Promptfoo-aligned assert-set across parser/schema/SDK/docs/examples/skills.
• Hard-reject authored type: composite with migration guidance and reject unsupported Promptfoo trajectory/tool/trace assertion names with future-scope diagnostics.
• Keep tool-trajectory as an AgentV-specific extension and document the divergence from Promptfoo trajectory:*/tool-call-f1/skill-used/trace-* names.

Verification

• bun --filter @agentv/core generate:schema
• bun --cwd packages/core test test/evaluation/validation/eval-file-schema.test.ts test/evaluation/validation/eval-validator.test.ts test/evaluation/validation/eval-schema-sync.test.ts test/evaluation/loaders/grader-parser.test.ts test/evaluation/graders/promptfoo-assertions.test.ts test/evaluation/orchestrator.test.ts test/evaluation/baseline.test.ts test/evaluation/token-usage.test.ts
• bun run validate:examples
• bun run typecheck
• bun run lint
• bun run test

Live dogfood

• bun apps/cli/src/cli.ts eval run examples/features/rubric/evals/operators.eval.yaml --targets .agentv/targets.yaml --target azure --workers 1
  • Passed 1/1: finance-summary-operator-guards, score 1, verdict pass.
  • Artifact bundle: .agentv/results/2026-07-04T05-36-38-920Z.
• Attempted local-openai, blocked before execution because LOCAL_OPENAI_PROXY_API_KEY was not set.
• Attempted direct openai, resolved credentials but provider execution failed with pi-ai call failed: Connection error.

Promptfoo source checked

• Local clone: /home/entity/projects/promptfoo/promptfoo
• Commit: 6bfc5a0c7f16f9c4717ac731d276b578e63d0769
• Confirmed AssertionSetSchema uses type: 'assert-set' and audited Promptfoo trajectory/tool/trace assertion names before rejecting unsupported future-scope names.